DAEMA: Denoising Autoencoder with Mask Attention

نویسندگان

چکیده

Missing data is a recurrent and challenging problem, especially when using machine learning algorithms for real-world applications. For this reason, missing imputation has become an active research area, in which recent deep approaches have achieved state-of-the-art results. We propose DAEMA (Denoising Autoencoder with Mask Attention), algorithm based on denoising autoencoder architecture attention mechanism. While most use incomplete inputs as they would complete - up to basic preprocessing (e.g. mean imputation) leverages mask-based mechanism focus the observed values of its inputs. evaluate both terms reconstruction capabilities downstream prediction show that it achieves superior performance several publicly available datasets under various missingness settings.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Reverberant speech recognition based on denoising autoencoder

Denoising autoencoder is applied to reverberant speech recognition as a noise robust front-end to reconstruct clean speech spectrum from noisy input. In order to capture context effects of speech sounds, a window of multiple short-windowed spectral frames are concatenated to form a single input vector. Additionally, a combination of short and long-term spectra is investigated to properly handle...

متن کامل

A Denoising Autoencoder that Guides Stochastic Search

An algorithm is described that adaptively learns a non-linear mutation distribution. It works by training a denoising autoencoder (DA) online at each generation of a genetic algorithm to reconstruct a slowly decaying memory of the best genotypes so far. A compressed hidden layer forces the autoencoder to learn hidden features in the training set that can be used to accelerate search on novel pr...

متن کامل

Speech enhancement based on deep denoising autoencoder

We previously have applied deep autoencoder (DAE) for noise reduction and speech enhancement. However, the DAE was trained using only clean speech. In this study, by using noisyclean training pairs, we further introduce a denoising process in learning the DAE. In training the DAE, we still adopt greedy layer-wised pretraining plus fine tuning strategy. In pretraining, each layer is trained as a...

متن کامل

1000 Fps Highly Accurate Eye Detection with Stacked Denoising Autoencoder

Eye detection is an important step for a range of applications such as iris and face recognition. For eye detection in practice, speed is as equally important as accuracy. In this paper, we propose a super-fast (1000 fps on a general PC) eye detection method based on the label map of the raw image without face detection. We firstly produce the label map of a raw image according to the coordinat...

متن کامل

Using denoising autoencoder for emotion recognition

In this paper, we propose to use the denoising autoencoder to generate robust feature representations for emotion recognition. In our method, the input of the denoising autoencoder is the normalized static feature set (state-of-the-art features for emotion recognition). This input is mapped to two hidden representations: one is to capture the neutral information from the input, and the other on...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Lecture Notes in Computer Science

سال: 2021

ISSN: ['1611-3349', '0302-9743']

DOI: https://doi.org/10.1007/978-3-030-86362-3_19